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I. INTRODUCTION 



One o-f the most acceptable means o-f determining the worth o-f a system, is by 
obtaining some sort o-f an e-f-fectiveness rating -for that system. This process of 
determining an effectiveness rating has for a long time been applied to military 
weaponry. It has become almost routine practice to ask for the effectiveness of 
the weapon system prior to any purchase. This is most often stated in terms of 

or probability of kill. The successfullness of applying this measure towards 
the success of the weapon, led to the evaluation of other systems in the same 
manner. The result was an ever increasing need to have some sort of an 
effectiveness rating for all types of systems. 

Applying some sort of an effectiveness rating to something as ill-defined as a 
Command and Control system, proved to be a challenge. Not only was there no 
real consensus as to what was a Command and Control system, but when a 
so-called system was to be evaluated there was no real feel as to what was a 
more effective system, either it worked and helped the organization or it hindered 
the organization. As it turned out most of the systems analysis conducted on 
Command and Control systems was based on the evaluator's past experiences or 
perception as to what a good Command and Control system should do and how 
well. There was rarely any set evaluation criteria to judge the effectiveness of 
the system. Thus, past studies barely accomplished more than identifying some 
problem area and recommending some solution that the evaluators thought would 
work. Almost never did the studies indicate what was effective or what standard 



was used in the evaluation. 



A remedy "to the subjective nature o-f Command and Control systems evaluations 
was needed. No longer could a Command and Control system compete -for the 
scarce de-fense dollars without some legitimate measure of system effectiveness 
being applied. To this end» the Headquarters Effectiveness Assessment Tool was 
developed. Its purpose is to enable a team of internal or external observers to 
objectively assess and quantify headquarters performance and effectiveness. 

This thesis will document one such application of this Headquarters 
Effectiveness Assessment Tool (HEAT) as it was conducted during JCS exercise 
Powder River 85. HEAT was applied to the Military Airlift Command 
Headquarters as it was organized for this exercise and generally how it is 
organized for a contingency. This thesis will further describe the HEAT process> 
including the theory behind HEAT and a brief historical perspective on the HEAT 
development in Chapter II. A description of the organization evaluated by this 
tool, Headquarters Military Airlift Command (HQi MAC), will be presented in 
Chapter III. This will include the organization of HO. MAC during a contingency 
operation or exercise, its relationship and coordination with the JCS Crisis 
Action System and the Joint Deployment Agency, along with a detailed description 
of MAC'S Requirements and Flow Planning Cell, the center of activity for the 
scheduling of airlift requirements. Chapter IV will present a detailed chronology 
of the HEAT evaluation of HQ MAC from the first preliminary aspect through a 
growing awareness of the true organizational function of MAC and the evolution 
of the HEAT measures as this awareness unfolded. The results and corrective 
recommended actions will be presented in Chapter V with a brief section 
indicating areas for further studies. 
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II. HEADQUARTERS EFFECTIVENESS ASSESSMENT TOOL (HEAT) 



A. HEAT HISTORICAL DEVELOPMENT 

The Headquarters E-f-fectiveness Assessment Tool (HEAT) development project 
was a joint initiative by the Defense Communication Agency (DCA) and the 
Defense Nuclear Agency (DNA). Their issue concerned the survivability and 
effectiveness of Command^ Control, Communications, and Intelligence (C3i) 
systems under the threat and during the course of a nuclear attack. Their mam 
question was one of organizational size. How small could theater level 
headquarters be while still maintaining the ability to survive and be effective. 
However, before the question of size could be answered, the problem of 
determining what is an effective headquarters had to be solved. DCA and DNA 
decided to first develop a method to differentiate between effective and 
ineffective headquarters performance. This, then, would be followed by the 
identification of factors that helped to explain, predict, and eventually be used to 
control the level of effective performance. 

Defense Systems, Inc. (DSD of Mclean, Virginia was awarded the developmental 
contract and was tasked with the accomplishment of these first two goals. Their 
product, HEAT, was develooed to meet these goals by enabling a team of internal 
or external observers to ob,lectively assess and quantify headquarters 
performance and effectiveness, yielding reproducible effectiveness scores. It 
was these reproducible, quantitative, objective scores which would enable the 
evaluation of a headquarters in different configurations (mobile, distributed, 
unitary, underground, airborne, etc.) and at different times, lending insight into 
the performance of command centers at all levels. 
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B. HEAT THEORY 



HEAT» as an analysis tool* was developed to render quantitative* objective* 
and reproducible effectiveness scores in order to assist those charged with 
designing and running a higher level headquartersi The application of HEAT was 
for those headquarters that were primarily responsible for the planning* 
supporting and coordination of fighting forces* not direct war-fighting 
CRef.l:p.l-2D. Hence* it was this process of planning the mission* acquiring the 
resources* and directing the forces to accomplish the mission that was being 
evaluated. True effectiveness* then* was measured by the ability of the 
headquarters to develop and implement such plans while ad,iusting them for the 
information and assets available. 

Other key concepts of headquarters effectiveness identified during the 
development of HEAT were: CRef.2:p.i-53 

* Effectiveness is the capacity to accomplish military missions. 

* Effectiveness of a theater-level headquarters is its capacity to operate as 
an adaptive control system such that it keeps crucial factors in its environment 
(enemy actions* losses of territory, casualties* etc.) within expected 
boundaries. 

* The primary measure of effectiveness is the capacity of the headquarters to 
develop plans and use the resources available to bring those plans to fruition. 

* When plans being used are not working* the effective headquarters is the one 
that can recognize that fact* develop alternative plans* and implement them in a 
timely fashion. The effective use of contingent options is an important issue* 
because of the uncertainty inherent in military operations. 

* Effectiveness is always measured in terms of interactions with the 
environment. 

* Timeliness* not speed* is essential for effectiveness. 

* Speed and good quality decision making processes may be necessary 
conditions for successful performance* but they are not sufficient for success. 



ii 



Thus an elective headquarters is one that can survive» continue to perform its 
assigned mission» and make its presence felt in its environment. One that 
effectively produces desired military outcome while efficiently using its 
resources and time. The concept of mission accomplishment is paramount. A 
headquarters can not be considered effective* no matter how well individual 
components accomplished their duties* if the mission failed. 

Recall* that the mission or objective of a headquarters (for a HEAT 
application) was that of planning for the war-fighting and not the war-fighting 
directly. As such* it would be inappropriate to use the result of combat as a 
measure of headquarters effectiveness. In fact* it could be argued that success 
in combat could occur even if the planning for a headquarters were ineffective. 
Thus* another conceptual approach or model to Judge headquarters effectiveness 
had to be chosen. The approach taken during the HEAT development was that of 
an Adaptive Control System. 

C. THE ADAPTIVE CONTROL SYSTEM 



Under this concept the headquarters is seen as a system whose purpose is 
effectively dealing with an environment. This environment consists of everything 
outside the headquarters and includes: ERef.l:p.2-8D 

* own forces and the related resources 
« enemy forces 

* relevant friendly forces 

- superior headquarters 

- adjacent military organizations 

- supporting subordinate military organizations 

* operating environment 

- weather 

- terrain 

- political situation 

- economic situation 

- social situation 
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In order to control these dynamic and sometimes interactive features of the 
environment^ a headquarters must proceed through a set of logical steps. These 
steps can be thought of as an adaptive control cycle for the headquarters or a 
headquarters cycle (see Figure 2-1). 

1. Monitor/Sense the Environment 

The control system must have a way to monitor those aspects of interest 
within its environment. It does this through the collection of raw data via its 
sensors. These sensors provide data on the aspects that the headquarters 
decides to monitor and hopes to control. The quality of this monitoring can be 
measured by comparing what the headquarters perceives to be true versus what is 
in fact "ground truth". Another indication of the quality of the monitoring 
process is the age of the data available. The quantity of old data indicates the 
quality of the monitoring process. 

2. Understand/Perceive the Situation 

Once the raw data is received by the headquarters* it must be processed into 
some usable form. This processed information is then used by the decision 
makers to interpret or understand the environment. This processed information, 
however* is almost never complete and up-to-date. Time delays occur through the 
processing of the raw data and through the communications delay from the 
sensors to the headquarters. Similarly, a sensor's information may be absent or 
misleading* instilling even more uncertainty into the evaluation. Thus* a 
headquarters can never be absolutely certain as to what is going on, but must use 
all available information to hypothesize about the current situation. This 
hypothesis of the situation can be correct* adequate for the mission* or incorrect. 
It is this quality of understanding the situation that HEAT measures. 
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3. Develop Alternative Actions 



The headquarter's next step» a-fter an understanding o-f the situation is 
reached) is to compile a list of alternative sets of actions. The emphasis at this 
point is not on a quality alternative but in surfacing a variety of different 
alternatives to evaluate. Experience with decision-making has made it clear that 
better decision processes are characterized by consideration of a number of 
alternatives and by the variety of alternatives considered. These are not 
measures of the effectiveness of the alternatives formulated but measures of the 
quality of the process used to develop them. 

4. Predict Results of the Alternative Actions 

For each alternative action deemed viable* the headquarters must predict or 
speculate on the results of that particular action. This must include at least two 
elements: CRef.3:p.3-13] 

a. do the force and material assets exist* or can they be assembled to carry 
out the alternative? 

b. what will the enemy's response be? 

This process of predicting the consequences of an alternative can be 
evaluated by determining: CRef.i:p.2-15D 

* their completeness: better prediction sets deal with questions of asset 
availability and enemy reaction across the full range of hypothesized 
situations for each alternative. 

* the correctness of those predictions actually adopted. This is measured on 

the same scale as the hypothesized understandings correct* not incorrect, 

and incorrect. 

5. Compare Prediction with Desired State 

This step in the headquarters cycle is implied by the model used bv HEAT 
but is better defined in J.S. Lawson's C3 model (see Figure 2-2). During this step 
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Figure 2-2 Lawson's C3 Model 
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the predicted results are compared against a desired outcome. Those 
alternatives that help achieve the desired result are considered tor possible 
execution. Those alternatives which do not meet or assist in obtaining the final 
desired state are discarded and not continued in the decision cycle. Thust this 
step is an aid to the decision maker# reducing the set ot possible alternative 
actions. 

6. Decide 

Probably the least understood ot the headquarters cycle steps# this is where 
the actual decision takes place to select a given course ot action# to develop a 
plan ot action. Ot all the alternatives remaining# the "best alternative" is chosen 
by the decision makers. This process is contingent on the particular headquarters 
and on the decision makers themselves. Due to the complexity ot the actual 
decision process# there are no direct measures on the quality ot the decision. 
Rather# the quality ot the decision made is reflected in the overall effectiveness 
ot the headquarters. However# measurable# tangible entities result from this 
step and the development ot a plan that includes the mission objective# the 
assets required# and the time-frame to accomplish the mission. 

7. Direct 

The resultant plan is communicated to the subordinate commanders. The 
directions given in the plan can be evaluated as to the extent that the 
headquarters correctly stated the environment and the required mission. An 
ordinal value ot "correct" or "incorrect" can be assigned by comparing the 
following components with their respective "ground truth": 

a. the mission statement 

b. the operational boundary or environment 

c. the assigned assets 

d. the time-frame to accomplish the mission 
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D. HEAT MEASURES 



If HEAT was applied in its entirety» across the full spectrum of the 
headquarters# in all of its roles and functions# then the HEAT application would 
yield six overall measures and 135 diagnostic measures of process or 
effectiveness. Of these 141 individual measures only two can be considered true 
measures of effectiveness. CRef.l:p.3-23 

1. Percentage of intended period that plan is not in force. 

2. Percentage of control cycles for which the control mechanism is: excellent, 
adequate# or inadequate. 

The 135 diagnostic measures are separable into the six headquarters process 
steps of the HEAT headquarters cycle (reminder# HEAT did not consider the 
compare function as a separate step). These measures are, also# separable into 
six data categories synonymous to the major functional components of a 
headquarters plan (see Figure 2-3). 

Applying all of these measures in a single evaluation would be an immense 
tasK# involving large amounts of data and data-gatherers. As such# the normal 
HEAT application focuses on scoping the 141 measures down to a reasonable and 
doable number CRef.l:p.3-l ]. This reduction in the number of measures in 
contingent on the application and the headquarters involved but more specifically 
on what measures the application will support based on the headquarters. 
Command and Control system being used. 

E. HEAT PROCESS 

Implementation of the HEAT process is far from automatic CRef.4;p.53. The 
first# and most important# task is of defining the application and the 
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Figure 2-3 HEAT Measures 



headquarters involved. This must be accomplished prior to beginning any of the 
steps in the HEAT application and is critical for the success of the HEAT 
evaluation. Without the most through understanding of the headquarters and the 
interrelationship of the headquarters internal structure (in regards to the 
particular application), one can not hope to capture the true effectiveness of that 
organization. 

This is where the user or headquarters must take an active part in the 
evaluation. The headquarters will provide insight as to which areas of the 
headquarters process it wants evaluated, indicate where in the internal 
organization those processes occur, and provide the observers with the access 
required to obtain any necessary data. In other words, the user or headquarters 
must have a thorough understanding of the HEAT process, just as the observers 
must have a thorough understanding of the headquarters. 

1. Defining the Problem 

The first step in the HEAT process, and the most important, is to define the 
purpose of the study and to determine the focus of the application. If sufficient 
time and effort was spent with the preparation work (as detailed in the previous 
paragraphs), the first portion is almost complete. There may need to be some 
refinement in the actual wording of the purpose to more closely align it with that 
of HEAT but it should be relatively straight forward. These will enable 
concentration into the more difficult portion of determining the focus of the 
evaluation. 

Focusing the application will determine the overall level of effort required 
and the kind of trade-offs that need to be made against the resource constraints. 
It will lead to the "first cut" of HEAT measures to be applied. This first-cut will 
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be based primarily on the purpose of the application and will lead into the second 
step o-f the HEAT process^ scoping the problem. 

2. Scoping the Problem 

During this phase » the task is cut down to a manageable size that is still 
broad enough to provide some response to the purpose o-f the study. Here» the 
user (headquarters) will -formally look into the organization* its functions of 
interest* and the functions that can be assessed with the available resources. 
This process consists of four steps: CRef.l:p.4-33 

* characterize the organization to be studied 

* identify functions for study 

* map the organization onto the functions 

* train the observers 

a. Understand the Organization 

This step starts with the internal relations identified by the head- 
quarters during the preliminary planning. The internal structure as presented by 
the organization is verified but more importantly any changes to the structure is 
annotated. Additionally* the so-called informal organization (the way the 
organization really works) is documented. Both of these must be captured for the 
HEAT application to be successful. 

b. Identify Functions for Study 

This process involves a collection and a refinement of the primary 
objectives identified during the problem definition phase. Here* the specific 
exercise or evaluation objectives are identified (see Figure 2-4). 

c. Map the Organization onto the Identified Functions 

The purpose of this approach is to outline to the observation team now 
many events are likely to involve each of the staff directorates (of the formal 
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PREPARATATION OF PLANS FOR CONVENTIONAL FORCES 
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Figure 2-4 Notional List of Exercise Objectives 



structure). This mapping (an example presented in Figure 2-5) will be use-ful in 

determining the amount o-f observers required to collect the data and help to 

scope down the HEAT measures to be evaluated. 

The last portion o-f this step* is the identification of the events which 
will support the various objectives. This will be useful in determining if the 

event provides enough data to be observed and in scheduling the limited 

resources available, 
d. Training 

Training is essential if the application is to be successful. Individual 
observers should be familiar with both the organization under study and the 
concepts and application of HEAT. In addition, the observers should be familiar 
with the concept of a control cycle and its application to that of the headquarters 
cycle. With these understandings, it is much more likely that the observers will 
observe and record significant data. 

In summary, a series of matrices (Figure 2-5) and time lines (Figure 2-6) 
should have been prepared to assist in the determination of what is doable given 
the limited resources. When concluded, the observer team should understand; 
CRef.l:p.4-93 

* what the problem is 

* what the organization of the HO. being studied looks like 

* what functions of the organization are to be tested 

* where and when the actions will take place 

* how many observers will be necessary to do the job 
3. Plan the Approach 

This phase is concerned with the details of the application. This includes 
the placement of the observers, the identification of the MOE's, deciding on an 
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Figure 2-5 Organization/Objectives Matrix 



START EX , TIME ^ END EX 
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Figure 2-6 Exercise Events Timeline 



approach to be taken» developing command standards* and developing a collection 
plan. 

a. Placing Observers 

Placement of the observers is a crucial step in obtaining useable data. 
The organization/function matrix will be of assistance during this step. There 
may be physical limitations imposed by the organization being evaluated* but if at 
all possible* have observation teams of two people for each of the organizational 
cells being studied. In addition* one or more roving observers will be required 
depending on the size and geography of the organization. These roving observers 
will assist the individual observation teams by transferring information between 
the respective teams. In addition* this observer would gather more a subjective 
impression of the overall organization. 

b. Selection of HEAT Measures 

Now that one has an understanding of how the Headquarters is organized* 
how it accomplishes its mission* what functions within the organization are going 
to be observed* and what the evaluation objectives are* one can now identify the 
specific HEAT measures to be evaluated. Since the HEAT measures are specific 
for a given Headquarters process and function* it is a simple matter to select 
appropriate measures once the function to be observed is identified. The specific 
measure can be isolated/narrowed even further by identifying the required data 
and verifying that that data can be collected. 

c. Decide on a Approach 

This step is concerned with what type of data to collect and how that data 
is to be collected. It also takes care of some of the logistics needs of the 
observation teams* such as: lodging* subsistence* access to operational areas* 
travel* and distribution of collected data. Data can be collected in many ways: 
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collect everything, collect in random cycles, or collect in prearranged cycles. 
Regardless, the sources o-f data must be identi-fied. Some examples of possible 
sources are: 

* brieting charts 

* messages 

* status reports and brie-fings 

* maps and photographs 

* telephone and radio logs or conversations 

* computer printouts 

* letters and memos 

d. Command Standards 

While this step is necessary tor the scoring o-f the collected data, it in 
itsel-f is not necessary -for the actual collection. However, having command 
standards (Figure 2-7) at the beginning will help identi-fy to the observers what 
is acceptable limits -for a given process. Regardless, to be truly acceptable, 
these standards should at the very least be concurred to by the Headquarters i-f 
not jointly developed. 

e. Develop a Collection Plan 

The Collection Plan (Figure 2-S) is where all the previous e-f-forts are 
documented. This is not a static document and it may (and probably snould> 
undergo many revisions be-fore a -final collection o-f the data is per-fcrmed. The 
collection plan will -function as a ledger o-f all past activities and the reasons -for 
them. If kept current, it will prove to be quite useful in documenting any changes 
in the final report. (This report format and premises of a current Collection Plan 
is the basis for Chapter IV). 
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Figure 2-7 Command Standards 
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Figure 2-7 Command Standards (continued) 



1.0 Problem Statement 



• Objective or Objectives 



2.0 Background 



2 . 1 Headquarters to be Studied 



• Organization 

+ Formal 

+ Informal 

• Personnel Assigned 

• System Organization 

• Functions of Interest 

2.2 Exercise 



• Details (Dares, Location, Participants) 

• Objectives 

• Objectives of Interest 

• Events of Interest from MIL or MESL 

• Points of Interest from Exercise Plan 

2.3 Resources 



• No. of Observers Available 

• Background of Observers 

• Objectives and Events to be VJorked 

• Travel Money Necessary 

• Locations to be Visited 



3 . 0 Abbroach 



3 . 1 Collection 

• Sources of Data 

+ Manuals, Messages, Exercise Plan, 

Directives, Interviews, Historical Data, 
Interviews 

+ List of all Possible and Most Probable 
+ Objectives and Events to be Worked 

• Quality and Detail of Data (All Data, Random 
Data, Planned Sequences of Data) 

• Procedures to Set Up Automatic Distribution 
(Messages, Briefing Slides, Telephone 
Summaries, etc.) 



Figure 2-8 HEAT Collection Plan Format 
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3.2 Observers 



• Organization 

+ Organization of Teams 

+ No. in a Team 

+ Team Reporting Structure 

+ Responsibilities 

• Objectives and Events to be Worked by 

Observers 

• Assignments 

3.3 Command Standards 



• Identify vrhat Types Needed 

+ MOE ' s , Data Sheets, Sources 

• Develop Early Straw Man, Iterate Approvals 
with User's 

4 . 0 Timing 

• Organization 

+ List All Details 

+ Arrange in Sequence for Accom.pli shments 

+ Assign Times 

• Suggested Topics 

Arrange Pre-Details, Deploy Advance Team., 
Deploy Observers, Collet Data, Arrange for 
Return to Base, Reduce Data Perform Analysis, 
Write-Up 

• Construct Task-Timing Chart 

5.0 Oustandinq Problems 



• Suggested Problem Areas: 

(Clearances, Travel, Local Travel, Food and 
Lodging, Courier Letters, Classified Storage, 
Badges, Who to Contact if Problems Occur) 

• Construct a Log Book Early and Iseep it 
Current 

+ All Decisions 

+ All Key Events 

+ All Problems — List What, vrho, and How 

Solved 



Figure 2-8 HEAT Collection Plan Format 
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4. Data Collection 



Upon reaching this stage o-f the HEAT process* most o-f the group's time and 
work has been completed* -for the rest is almost mechanical in nature. There is 
however* one more important step that could save time and avoid complications* 
deploy an advance party. This advance party will take care o-f all the logistic and 
administrative items that were missed. Items that their checklist should include 
are: 

* clearances* lodging* and local transportation -for all observers 

* arranging -for the automatic collection o-f certain data 

- messages* incoming and outgoing 

- brie-fing slides* notes* minutes 

- telephone and radio logs 

- internal memos and letters 

- data automation products 
5. Analysis and Write-up 

With the multitude o-f data collected* it is now time to do some thing with it. 
One o-f the most use-ful tools in organizing the data -for analysis is a time-line 
(re-fer to Figure 2-6). This time-line may be a simple listing o-f the chronological 
events or a more complicated time diagram illustrating intervals between events 
as well. Depending on the complexity o-f the evaluation* it may be desirable to 
have multiple time-lines* one -for each function observed or one for each 
headquarters cell observed. Regardless of how detailed* a time-line will ease 
the data reduction and analysis. 

HEAT also offers two other aids to data analysis. After the data is 
collected it is entered onto data sheets (Figures 2-9 and 2-10). These sheets 
identify what specific information is needed for each of the functions or 
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DATA 



SHEETS 



Decision-Direction Data Sheet (Code D) 
Enemy Unit Data Sheet (Code E) 
Environment Data Sheet (Code V) 
Friendly Unit Data Sheet (Code F) 
Guidance .Message Data Sheet (Code G) 
Information Report Data Sheet (Code I) 
Outgoing Cucries Data Sheer (Code 2 ) 
Prediction Data Sheet (Code P) 

Soecial Weaoons Data Sheet (Code W) 



10 . 


System Cperaoi 


lity Data Sheet 


( Code 


s) 




Understanding 


(External) Data 


Sheet 


(Code X) 



unaer s tanoinc 



dine (Own Forces) Data Sheet (Code U) 



Figure 2-9 HEAT Data Sheets 
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measures o-f interest. This process helps to reduce data -from a variety o-f 
sources to only a -few separate data sheets (a -few hundred at times) referencing 
the original document. The next reduction o-f data is accomplished thru the 
process o-f transcribing certain information from the data sheets to the HEAT 
score sheets (Figures 2-11 and 2-12). These data sheets and score sheets are 
cross matched with each score sheet identifying which data sheets are needed to 
complete it and vice versa. The only additional input needed for the score sheets 
is the command standards. These standards* as mentioned earlier (Figure 2 - 7 ), 
are needed to score what the organization views as acceptable limits or variation. 

Once all the analysis is conducted* the final report can be assembled. This 
report* format presented in Figure 2-13* should include a brief description of 
HEAT* a description of the organization studied* a chronology of exercise events* 
and the data analysis along with the conclusions and recommendations. 
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SCORING SHEETS 



1. Alternative Actions Scoring (Code A) 

2. Decision (Direction) Scoring (Code D) 

3. Enemy Location Scoring (Code L) 

4. Enemy Monitor/Report Scoring (Code M) 

5. Enemy Unit Timeliness Scoring (Code E) 

6. Environment Report Scoring (Code V) 

7. External Conditions Scoring (Code K) 

8. Guidance Message Scoring (Code G) 

9. Headquarters Cycle Scoring (Code H) 

10. Information Report Scoring (Code I) 

11. Own Timeliness Scoring (Code F) 

12. Own Unit Accuracy Scoring (Code 0) 

13. Plan Quality Scoring (Code Q) 

14. Prediction Scoring (Code P) 

15. Report (Prediction) Scoring (Code T) 

16. Report (Understanding) Scoring (Code R) 

17. Special Weapons (Category) Scoring (Code C) 

18. Special Weapons (Perception Scoring) (Code W) 

19. Understanding (Enemy) Scoring (Code X) 

20. Understanding (Implementation) Scoring (Code U) 

21. Understanding (Operability) Scoring (Code S) 



Figure 2-11 HEAT Score Sheets 
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FiquiTB 2~12 Exa.n\pls HEAT Scoitb ShGSt 



A. 



INTRODUCTION 



• Problem to be studied 

• Purpose of the exercise 

• Overview of the analysis 

B. HEAT OVERVIEW 

C. DESCRIPTION OF THE XYZ HEADQUARTERS PROCESS CONCERNING 
THE EXERCISE PURPOSE 

• XYZ Headquarters Command Relationships to Superior 
and Component Organizations 

+ Formal 

+ Informal 

XYZ Headquarters Organization 
+ Formal 

+ Informal 

• Process Information Flow 

+ in terms of the generic headquarters process 
( brief ) 

+ in actuality (as much detail as necessary to 

serve purpose of analysis document) 

D. NARRATIVE AND CHRONOLOGY 

• Time-line of events 

• Narrative focusing on patterns of stimulus- 

dec is ion- response-out come 

E. ANALYSIS 

• XYZ Headquarters processes and Effectiveness 

+ Monitoring 

Data Base Accuracy 

- Data Base Timeliness 

- Queries for/on reports 

+ Understanding 

+ Planning 

- Developing Alternatives 

- Developing Predictions 

Figure 2-13 HEAT Report Format 
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+ Direct (Coordinate) 

- Compliance of coordination actions with 

higher guidance 

- Timeliness of coordination actions 

+ Query-Response 

- Queries on XYZ Headquarters messages 

- XYZ Headquarters responsiveness to 
queries for information 

• XYZ Headquarters opportunities vis-a-vis original 
problem statement 

F. CONCLUSIONS AND RECOMMENDATIONS 



Figure 2-13 HEAT Report Format (continued) 
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III. HEADQUARTERS MILITARY AIRLIFT COMMAND (HQ MAC) 



A. INTRODUCTION 

How does the Military Airlift Command accomplish its mission? For that 
matter how does it receive its mission requirements» especially for any given 
contingency. These questions will be addressed in the next few pages. 

The Military Airlift Command's mission is varied and complex. As a Specified 
Command* it is responsible for the air transportation of both cargo and troops. 
This includes both long haul/trans-oceanic movement and also* intra-theater 
movements. As described in Air Force Regulation 23-17 its mission is one of 
support to the Theater Commanders. 

"The overall mission of MAC is to maintain* in a constant state of readiness* 
the military airlift system and other systems and services to perform all tasks 
assigned by the Joint Chiefs of Staff (JCS) and appropriate JCS and Air Force 
guidance documents." CRef. 5;p.l-33 

However* it has a dual role. MAC must not only transport the needs (people* 
equipment* etc.) of the theater commanders* but also* their own requirements. 
Many times MAC must transport additional support equipment so that it can 
accomplish its primary goal of support to the theater commanders. It must ensure 
that all the necessary ground equipment is at the receiving air field to enable 
their self to accomplish their mission. As such* MAC has the dual role of being a 
supporting CINC and a supported CINC. This complexity of a dual role plays an 
important part in MAC'S interface with the Joint Deployment Agency (JDA) and 
the Joint Deployment System (JDS). 
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B. THE JOINT DEPLOYMENT SYSTEM 



The Joint Deployment System (Figure 3-1) was developed to more e-f-ficiently 
handle the immense task of support to theater commanders especially during 
times of crisis. At the core of the JDS is the planning cycle which refines the 
operational plan (OPLAN) and produces Timed-Phased Force Deployment Data 
(TPFDD) for the OPLAN. This TPFDD sets the initial data base as to which units 
are to be employed^ which units require deployment^ along with an estimate of the 
transportation requirements and a priority code to indicate the order or sequence 
of their movement. A brief look at this planning cycle is in order before 
preceding to look at the actions taken during a contingency situation. 

The planning cycle begins when the supported commander produces a plan 
concept. This plan concept is in turn used to initiate a basic TPFDD for 
submission to JDA for review and refinement. The submitted TPFDD will include 
as much of the following information as possible. CRef.6:p.4-2D 

- types of forces required 

- type of unit» movement data (TUCHA) **** 

- providing organization 

- proposed routing 

- proposed origin 

- proposed ready to load date at origin 

- earliest and latest arrival dates at port of debarkation 

- desired port of debarkation 

- required delivery date at debarkation 

The review process is accomplished in two phases. Phase 1 validates ana 
completes the supported commander's TPFDD to permit more accurate evaluation 
of transportation requirements and the scheduling of movements CRef.6:p.4-3]. 
This is accomplished by identifying the actual force units to meet force 
require mentSf any non-unit personnel or augmentation requirements* and the 
actual movement characteristics (as listed above) of these requirements. The 
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Figure 3-1 Joint Deployment System Configuration 



supported commander and the supporting commander resolve any variations or 
changes and identity any short-falls in meeting the requirements. All o-f the 
following actions are taken during the Phase 1 validation. CRef.6:p.4-61 

- refinement and completion of the TPFDD 

- designation and validation of specific forces 

- identifies force shortfalls# coordinates resolution if possible 

- determine capability to fill non-unit personnel or augmentation requirements 

- identifies non-unit personnel shortfalls 

- establishes dates for the supporting commands to finalize movement tables 

and sets a date for the next review# Phase 2. 

Phase 2 verifies that the transportation requirements are within the 
capabilities of the Joint Services. All transportation difficulties are resolved 
and any shortfalls in force structure are accounted. Upon resolution of all 
shortfalls the TPFDD is finally ready to be included in the OPLAN and loaded as 
the JDS data base for that OPLAN. This data base is the basis of all 
transportation requirements if this OPLAN is exercised. 

The JDS data base can be quite useful during a crisis situation. As it contains 
a basis to begin planning# it is used throughout the Crisis Action System (CAS) 
planning cycle. This cycle is divided into six phases CRef.6:p.6-l ]. 

(1) Phase I - Situation Development. 

<2) Phase 2 - Crisis Assessment. 

(3) Phase 3 - Course of Action Development. 

(4) Phase 4 - Decision. 

(5) Phase 5 - Execution Planning. 

(6) Phase 6 - Execution 

The JDS data base plays only a minor role in the first two phases of the CAS 
cycle. Phase 1 is the identification of a possible crisis situation and the 
reviewing of available plans or options. Here# the JDS data base is used for 
problem analysis and to determine if there exists an OPLAN and TPFDD for the 
possible crisis. During Phase 2# a crisis is actually declared. In this phase the 
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JDS data base continues as a problem analysis tool but> more emphasis is placed 
on the impact o-f execution o-f the OPLAN(s). 

Phase 3 is the -first operational use of the JDS data base. Upon issuance of 
the Warning Order (issued at the end of Phase 2)» the Joint Deployment Agency 
starts preparing a deployment estimate to include a tentative C-day and L-hour. 
This can be accomplished in three ways. First* if an existing OPLAN covers the 
situation JDA will load its associated TPFDD for immediate update and 
refinement. Second* if the appropriate OPLAN requires modification* the JDS 
data base has been modularized to ease any modification. The last and most time 
consuming case is if no OPLAN exists. Here* the procedures identified in the JDS 
planning cycle (OPLAN and TPFDD refinement) need to be accomplished. Once the 
initial requirements are identified by the supported commander* they are entered 
into the data base for refinement under this phase. The validation (the review 
process mentioned in preceding paragraphs) is not conducted per se but* at the 
expense of probably more transportation shortfalls. These shortfalls are a 
direct result of not enough time to enable the more thorough review afforded 
when a plan is not prepare in a crisis situation. 

Again* during Phase 4 the JDS data base is not used extensively. After the 
update to the data base is accomplished in Phase 3* JDA provides this 
information in a capsulized form* along with a tentative C-day/L-hour to the JCS. 
The JCS will then issue an Alert Order which will initiate Phase 5. 

The Execution Planning* Phase 5* begins upon receipt of the proposed 
C-day/L-hour in the Alert Order. JDA will immediately coordinate with the 
supported and supporting commanders and recommend a firm C-day/L-hour. At 
the same time* JDA will accomplish and coordinate any last minute updates to the 
data base* focusing on the first six days of air movement and the first 30 days 
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■for sur-face movements# based on earliest arrival date (EAD). JDA will continue 
to update the data base in one-day increments -for those C+5 and C+29 day air and 
sur-face requirements. 

Extensive participation by the supporting commanders is required during this 
phase. The procedures that the Military Airli-ft Command (MAC) -follows will be 
discussed in detail. However# keep in mind that similar actions are taken by the 
Military Tra-f-fic Management Command and the Military Sealift Command for 
surface movements. 

Upon notice from JDA that the first six days of the data base is ready# MAC 
will pull or extract the first five days of air movement requirements# based on 
latest arrival date (LAD). (Reminder; JDA accomplishes their update by EAD# this 
could possibly cause some conflict). These requirements are grouped by 
ONLOAD/OFFLOAD channels (scheduled air routes). MAC will then develop 
schedules to meet the requirements over these onload-to-offload channels. MAC 
will, as soon as possible# send the first two days of schedule back to the JDS. 
This will be followed by the remaining three days. This will enable JDS to assign 
specific units of payload# by the requirement's priority of movement# to the 
scheduled carrier. This process will repeat itself in 1-day increments upon 
notification from JDA that the next days movements are available for scheduling. 

The last phase# Phase 6 - Execution# is initiated when the Execute or 
Deployment Order is issued. Once again the JDS data base has a limited role. 
The actual Execution Phase is the direction and monitoring of previously planned 
movements. Thus# there is a constant transition between these last two phases. 
While one day's movements are being executed# one-plus-five day's requirements 
are being scheduled. In fact# in a changing situation where the original OPLAN is 
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no longer validi returning to Phase 3 and the current day's movements may be 
required. 

As described) one can see the bene-fits of this system as a management aid> 
especially during times of con-flict. Briefly* the JDS is a data base to help the 
supported commanders identify their requirements for a given OPLAN. To obtain 
this data base# the supported commander must develop Time Phased Force 
Deployment Data or TPFDD. This TPFDD goes through a review process to 
decrease the possibility of transportation shortfalls (this usually means a 
decrease in requirements at this stage)* and once finalized is the basis of support 
for that OPLAN. When a crisis develops* planning is expedited if an OPLAN and 
TPFDD exist. Regardless* crisis planning is accomplished in the six phases of 
the Crisis Action System (CAS). Throughout* CAS planning relies heavily on the 
JDS data base (as always the data base is only as good as its last update* it 
therefore relies heavily on the CINC's for update). Even during times of 
transition between OPLANs* the JDS data base can be used to more efficiently 
and quickly identify new requirements and schedule their movements. 

C. THE MILITARY AIRLIFT COMMAND 

The previous section described how MAC received its movement requirements 
and very briefly how MAC interfaced with the Joint Deployment System (JDS). 
Now* we will take a more in depth look at how MAC schedules aircraft to meet 
these requirements and how MAC responds to a crisis situation. 

MAC is an active participant in the JCS Crisis Action System (CAS). In 
response to a more formalized procedure to support the CAS* MAC formed the 
Headquarters MAC Crisis Action Team (CAT). This CAT provides for the 
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inter-face between JCS requirements and the scheduling o-f those requirements. 
As such» the CAT is the MAC -focal point during a crisis. 

The Headquarters MAC Crisis Action Team (CAT) provides CINCMAC 
expedited sta-f-f action and a single -focal point within the MAC sta-f-f -for the 
execution management o-f MAC -forces during time-sensitive operations. 
Additionally, the Headquarters MAC CAT serves as a single sta-f-f activity for 
providing required critical information to the JCS, other tasking agencies, and 
subordinate MAC organizations. 

The Headquarters MAC CAT acts as CINCMAC's executive agent. 
Instructions issued by the MAC CAT through the MAC CAT Director are 
directive upon the MAC staff and all MAC forces. CRef.7:p.i-l 3 

The MAC CAT (Figure 3-2) is organized in a layered approach with only the 
Prime CAT being immediately notified in a crisis situation. The senior airlift 
controller will then recommend to the CAT Director the addition or deletion of 
CAT members based on the nature of the crisis CRef .7:p.2-23. These additional 
personnel may include the Special CAT, task-oriented support ceils, or any other 
designated individuals. The Prime CAT will be the principal agency through which 
command guidance is passed for implementation CRef.7:p.3-i 3. For closely held 
operations, the Prime CAT may be the sole members responsible for developing 
MAC'S course of action. Composition of the MAC CAT is diagramed in Table 3-1. 

1. The Prime Crisis Action Team 



The Prime CAT will focus on airlift concept development, coordination with 
JCS. Services and supported commands, as well as monitoring the execution of 
airlift operations. The Prime CAT will be the principal agency through which 
command guidance is passed for implementation. CRef.7:p.3-13 
a. The CAT Director 

The CATD acts as CINCMAC's executive agent. All CAT messages are 
released under his authority. His responsibilities are: CRef.7:p.4-33 
(1) Ensure the proper response to emergency requirements 
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Figure 3-2 HQ MAC Crisis Action Team Organization 



TABLE 3-1: HQ MAC CAT MANNING/ SOURCING 



Prime CAT: 

Director (CATD> Operations <CAT0) 

Executive 0-f-ficer (CATE) Operations Plans <CATX» 

Executive Support NCO (CATN) Transportation (CATT) 

Logistics (CATL) 



Special CAT: 

Intel 1 i gence 
Secur i ty Police 
Comp trol 1 er 

Engineering and Services 
Chap lam 

Assistant tor Civil Air 
Adm i n i strat i on 
Special Operations 
Operat i ons 
Transpor tat i on 
Operations Plans 



Commun i cat i ons 
Surgeon 

Publ i c At+a i rs 
Weather 
Personnel 
AFOSI 

Data Automat i on 
Statt Judge Advocate 
Command and Control 
Logi st i cs 
Liaison Groups 

(Army ,Navy ,Mar i ne ,TAC,SAC ,ESC , 
AFRES,and ANG as required) 



Task-Oriented Cells: 

Support Cell 

Requirements and Flow Planning 

Manpower/Personnel Readiness 

Mission Support and Augmentation 

Station Data 

Port Management 

Connec t i v i ty 

Reports and Brie ting 

Classitied Automated System (WIN) 

Administrative Support 

CRAF Representatives 



Responsible to Special CAT 
Operations Rep 
Personnel Rep 
Operations Plans Rep 
Logistics Rep 
Transportation Rep 
Command and Control Rep 
Command and Control Rep 
Command and Control Rep 
“Prime CAT Exec (CATE)" 
Assistant tor Civil Air 
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(2) Ensure tasks assigned to MAC are accomplished 

<3) Ensure CINCMAC and sta-f-f are in-formed of all critical information 
impacting the Command 

(4) Serve as the primary point of contact for JCS» Air Force» supported CINC> 
and MAC numbered Air Force Battle Staff/CAT directors. 

b. The CAT Executive Officer 

The CATE serves as the executive officer and the administrative officer 
for the CATD. As such his duties include the screening of incoming /outgoing 
messages* maintaining the CAT message file* and provide administrative support 
as required. 

c. The CAT Executive Support NCO 

The CATN is the chief administrative clerk for the MAC CAT. He ensures 
that all needed administrative support is available. 

d. The CAT Operations Officer 

The CATO assists the CATD in developing MAC courses of action. He 
serves as primary contact and director of all MAC Air Force operations. He is 
responsible for directing and supervising the activities of the Special CAT 
Operations and Command and Control representatives to include determination of 
airlift requirements* flow planning* airlift taskings* emergency action procedures* 
communications connectivity requirements* and reports and briefings. He is also 
responsible for consolidating the daily situation report (SITREP). CRef.7:p.6-21 

e. The CAT Operations Plans Officer 

The CATX is responsible for accomplishing the required emergency action 
procedures. In addition* he provides the required information applicable to 
existing support plans. 
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i. The CAT Transportation 0-f-ficer 

The CATT is responsible tor Airlitt Concept Development in relation to 
the aerial port. He monitors aerial port manpower and equipment resources and 
directs relocation of assets as appropriate, 
g. The CAT Logistics Officer 

The CATL is responsible for the maintenance and supply support for the 
airframes and aerial ports. 

2. The Special Crisis Action Team 

The Special CAT encompasses most functional areas within the head- 
quarters. Special CAT members serve as the direct liaison between the Prime 
CAT and their assigned functional areas. It should be emphasired that Special 
CAT members do not work in isolation. They are expected to call on members of 
their functional area staffs to assist them as required. CRef.7:p.3-2] 

3. The CAT Support Cells 

TasK-Oriented Support Cells (Figure 3-3) combines expertise from across 
the MAC staff into specific task-oriented teams. Cell composition should be 
reviewed frequently by cell team chiefs to ensure the most effective and efficient 
manning is assigned to conduct the detailed staff work required. CRef.7;p.3-2 1 
a. The Requirements and Flow Planning Cell 

This cell analyzes movement requirements and the airlift capability to 
meet the requirements. They are responsible to prepare a flow plan (airlift 
schedule). 
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b. The Manpower/Personnel Readiness Cell 

This Support Cell is responsible tor personnel tracking. In conjunction 
with Air Force Personnel Readiness Center ensures the augmentation ot -forces 
when required. 

c. The Mission Support and Augmentation Cell 

This cell is responsible tor personnel tracking and tasking with the MAC 
torces. When mobilization is requiredf they must turnish the manpower and 
personnel readiness cell with validated requirements. 

d. The Station Data Cell 

The Station Data Cell has responsibility tor the tracking ot airfield 
suitability. 

e. The Port Management Cell 

This Support Cell monitors the passenger and cargo workloads at the 

airtields. 

t. The Connectivity Cell 

This cell insures real-time interoperability between the intelligence » 
operations, communications, and command and control functional areas. 

g. The Reports and Briefing Cell 

This Support Cell reviews all reports and briefings prior to the CATD 
approval and release. 

h. The Classified Automated System (WIN) Cell 

The WIN Cell operates and ensures continuous connectivity over the 
WWMCCS Interface Network (WIN). 

i. The Administrative Support Cell 

The Administrative Support Cell is responsible to the CATE and CATN to 
provide required administrative support. 
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j. The CRAF Representative Cell 

This Support Cell provides information and advice on the Civil Reserve 
Air Fleet. 

While each CAT member or task cell accomplishes a vital -function> it is 
primarily the Operations and Command and Control representatives to the Prime 
and Special CAT that interfaces most with the Joint Deployment System (JDS) and 
the MAC forces. As such# the CATO is the focal point of all actions effecting the 
scheduling or movement of MAC forces. He has direct responsibility for the 
Special CAT Operations and Command and Control sections. As mentioned 
previously his responsibilities bear repeating. 

The CATO will assist the CATD in developing MAC courses of action during 
concept development# and make necessary revisions during execution. The 
CATO will serve as the CATD's primary contact with# and director of# all MAC 
Air Force operations. The CATO is responsible for directing and supervising 
the activities of the Special CAT Operations and Command and Control 
representatives to include determination of airlift requirements# flow planning# 
airlift taskings# emergency action procedures# communications connectivity 
requirements# and reports and briefings. The CATO is responsible for 
consolidating the daily situation report (SITREP). CRef.7:p.6-2D 

The CATO further divides his multitude of responsibilities between the Special 

CAT Operations and Special CAT Command and Control. The Special CAT 

Operations representative is mostly concerned with the operations of the MAC 

forces. His activities include airlift requirements# flow planning# airlift 

taskings# and emergency action procedures. Of primary concern are the first two# 

airlift requirements and flow planning accomplished by the Requirements and 

Flow Planning Cell. The Special CAT Command and Control representative is 

concerned with the communication of information from the requirements to the 

forces and the reporting of the forces current status. Of most importance is the 

interface with the JDS accomplished by the Classified Automated Systems (WIN) 

Cell. We will take a closer look as to how these two cells accomplish their duties. 
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The Classi-fied Automated System (WIN) CelU consisting oi up to nine NCO's 
(depending on the severity of the contingency and on WIN traffic load)* has a very 
simple yet* important task; to maintain communications over the WWMCCS 
Interface Network (WIN). This network is used to communicate or access the JDS 
data base and secondly* for other message traffic to and from supported 
commanders or MAC forces. As such* it is the prime communications media by 
which MAC receives its requirements and informs others of its scheduled airlifts. 
This system or cell supports all the CAT members but in particular the 
Requirements and Flow Planning Cell. 

The Requirements and Flow Planning Cell* consisting of between four and six 

officers* is the one entity which is directly evolved in all phases of the 

operational mission planning. Upon receipt of the requirements from either the 

JDS or some other means* this cell must develop a schedule of MAC airflights to 

fulfill the requirements. In this aspect* they are the direct users of the JDS data 

base and their scheduling product is the required input into the Joint Deployment 

System. The Requirements and Flow Planning Cell responsibilities include but 

are not limited to the following CRef.7:p.6-3 1: 

(a) Determining and analyzing movement requirements and current airlift 
capability to meet those requirements based on guidance from the Special CAT 
Operations representative. 

<b) Preparing manual flow plans to support crisis/contingency requirements. 

(c) Preparing applicable portions of the CAT worksheets to establish 
parameters for operators to input to FLOGEN when generating an automated 
airlift flow. 

(d) Monitoring and analyzing the automated airlift schedule to determine airlift 
flow constraints* recommending changes to improve the flow and* with the 
concurrence of the Special CAT Operations representative* implementing 
required changes. 

(e) Preparing and coordinating MAC mission directives for CATD release. 
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(f) Chairing intercell discussions to ensure unified actions to support the 
operational requirements. 

Three of the above six responsibilities deserve some additional clarification 
and explanation. To begin with» once the requirements are retrieved from the JDS 
data baser they are inputted into MAC'S automated flow generator (FLOGEN). The 
end product from the FLOGEN system is then analyzed for deficiencies 
(deficiencies are inherent within the FLOGEN product^ some of these will be 
discussed later). The Requirements and Flow Planning Cell will combine some 
under utilized air missions and cancel some completely due to their limited cargo. 
Once updated the final schedule is then loaded into the JDS data base and 
previously prioritized TPFDD cargo is manifested against a particular air 
movement. 

The final responsibility of interest is that of manual flow planning (manual 
scheduling of aircraft). This immense and sometimes unmanageable task is 
mandated if there is less than 72 hours to first air movement and no OPLAN 
(TPFDD) exist. Additionally» if any changes are necessary tor the next three 
days of schedule» it must be done manually since FLOGEN can only change the 
schedule beyond 72 hours. (This causes a change in the data base of the OPLAN 
or TPFDD. HO. MAC estimates the 72 hours for development of the new data 
base.) If dictated^ mission planners must manually match JDS requirements with 
available resources and produce a complete^ workable schedule. A small 
indication of this immense task is illustrated in Figure 3-4. 

To briefly recap» MAC is an active participant in the JCS Crisis Action System 
(CAS). Its main body of response is the MAC Crisis Action Team (CAT) which 
provides for the command's focal point in a contingency operation. The MAC CAT 
has a layered organization consisting of the Prime CAT» the Special CAT> and Task 
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Oriented Cells. This approach provides flexibility in assembling only those units 
required for the crisis. As mentioned previously* two of the most important Task 
Oriented Cells are the Classified Automated System (WIN) Cell and the 
Requirements and Flow Planning Cell. While the "WIN" Cell provides the 
connectivity to retrieve the requirements and load the completed schedule* it is 
the Requirements and Flow Planning Cell which performs/executes the 
Headquarters MAC mission. This immense task of air movement scheduling is 
automated to some degree but* inherent deficiencies necessitates at least manual 
analysis if not a complete manual schedule. 



IV. POWDER RIVER 1985 HEAT COLLECTION PLAN 



A. PRELIMINARY COLLECTION PLAN 

This chapter will document the changes in the approach taken using HEAT to 
evaluate HQ. MAC during Powder River 1985. The -first encounter with HEAT and 
its application towards PR35 occurred in August 1984. At that time a HEAT 
training session was held and some very preliminary introduction to HQ MAC was 
accomplished. 

The next meeting concerning HEAT or HQ MAC was in September 1984, 
approximately three weeks later. At this time it was deemed appropriate to visit 
HQ MAC and obtain more in-formation as to how HQ MAC is organized during a 
contingency. Prior to this visit, it was appropriate to prepare a tentative list o-f 
ob^ctives. This Preliminary Collection Plan (Figure 4-1) was comprised only o-f a 
problem statement and a tentative list o-f HEAT measures. This in-formation was 
based only on a general knowledge o-f HQ MAC and air operations. 

B. INITIAL COLLECTION PLAN 

During the HQ MAC visit in late September, 1984, a tour o-f the Crisis Action 
Center was given. This tour, even though given during a period o-f construction 
was enlightening on how the MAC CAT operated during a contingency. 
Additionally access was a-f-forded to a dra-ft copy of MAC Regulation 55-28. HG. 
MAC CRISIS ACTION TEAM GUIDANCE, MAC'S supplement to JCS's Powder Rive- 
1985 Manual (S), and a listing of exercise events list (S). All of this information 
proved useful in preparing the first draft of the Powder River 1985 Collection 
Plan (Figure 4-2). 
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HEADQUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 19S5 



1 .0 Problem Statement 

Perform a -feasibility analysis -for HQ MAC. 

* Can HEAT be applied -for HQ MAC. 

Use representative measures -from each data category. 
(Personnel Data Category not covered in original 
measures) . 

Can Command Standards be ouanti-fied. 



2.0 Evolution of HEAT Measures 
Data Category 
Enemy Units 
Enemy Objectives 
Enemy Timetable 
Combat Units 
Support Units 
Un i ts not in Theater 
Coord/Support Units 
Weather 

Pol i t/Econ/Soc Gu i dance 
Critical Shortages 



Measure II'' s 



2, 


3, 


4, 


104, 


106 








12, 


13, 


110 












18, 


19, 


1 10 












1, 


2, 


3, 


24, 


25, 


94, 


99, 


113 


1, 


2. 


2 > 


24, 


25, 


96, 


101 , 


113 


1, 


2, 


3, 


97, 


102 








1 , 


2, 


3, 


98, 


103 








8, 


34, 


108, 


118 










11 5 


40, 


65, 


74 










30 , 


31, 


56 , 


60 , 


64, 


73, 


117. 


127 



Figure 4-i Preliminary Collection Plan 
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HEADQUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 1985 COLLECTION PLAN 
3 OCTOBER 19S5 



1 .0 Problem Statement 

Per-form a -feasibility analysis -for HQ MAC. 

* Can HEAT be applied -for HQ MAC. 

Use representative measures -from each data category. 
(Personnel Data Category not covered in original 
measures) . 

— Can Command Standards be quant i-fied. 

— Are there observable HQ cycles, i -t so observe a limited 
set (2). 

Is HEAT more applicable at a Numbered Air Force or Air 
Division level. 

* I-f HEAT can be applied, will it yield use-ful in-formation. 

Is the Contingency Action Team (CAT) organizational 
structure adequate -for the mission. 

Is the concept o-f Air operat i ons-vs-HQ directorates 
appropr i ate . 

— Are CAT procedures adequate -for the mission. 

Is training needed, i-f so: where, what type. 



2 . 0 Background 

2 . 1 Headquarters to be Studied 
» MAC CAT 

Required representation. 

— Procedure -for calling and the use o-f the Special CftT 
and the -functional units (i.e. Connectivity Cell). 

* Organization and Responsibility 
— Prime CAT 

The Prime CAT will focus on airlift concept 
development, coordination with JCS, Services and 
supported commands, as well as monitoring the 
execution of airlift operations. The Prime CAT will 
be the principal agency through which command guidance 
is passed for implementation. For close hold, 
conventional operations, the Prime CAT, augmented on a 
selected basis by supporting CAT members, will develop 
MAC courses of action for CINCMAC, JCS, and supported 
CINC approval . 



Figure 4-2 Initial Collection Plan 
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Hann i no 



— Prime CAT Manning and Sourcing 



Pos i t i on 



Source 



Director <CATD) 


MAC/DO 


06 


Executive Officer <CATE) 


MAC Staff 


04/03 


Executive Support NCO <CATN) 


MAC Staff 


E6/E5 


Operations <CAT0) 


MAC/DO 


06 


Operations Plans (CATX) 


MAC/XO 


05 


Transportation <CATT) 


MAC/TR 


06 


Logistics (CATL) 


MAC/LG 


06/05 


Special CAT 

The Special CAT encompasses most functional 


areas 



within the headquarters, 
liaison between the Prime 



Special CAT members serve as the direct 
CAT and their assigned functional areas. It 



should be emphasized that Special CAT members do not work in isolation. 
They are expected to call on members of their functional area staffs to 
assist them as required. 

— Special CAT Sourcing 



Posi t i on 




Source 


Intel 1 i gence 




IN 


Conxnun i cat i ons 




DC 


Secur i ty Police 




SP 


Surgeon 




SG 


Comptrol 1 er 




AC 


Liaison Group 


Army, 


Navy, 




ESC, 


AFRES, 




Personnel , as 


Publ i c Af f ai rs 




PA 


Engineering and Services 


DE 


Weather 




DOW 


Chapi ai n 




HC 


Assistant for Civil 


A i r 


XPW 


Personnel 




DP 


AFOSI 




AFOSI 


Admin i strat i on 




DA 


Data Automat i on 




AD 


Special Operations 




DOX 


Staff Judge Advocate 




JA 


Operat i ons 




DOO 


Command and Control 




DOC 


Transpor tat i on 




TR 


Logi st i cs 




LG 


Operations Plans 




XO 


Figure 4-2 Initial Collection Plan <cont 



Marine, TAC, SAC, 
and ANG Liaison 
as required. 



.2 



.3 



Task-Oriented Support Cell 

The Task-Oriented Support Cells combines expertise 
•from across the MAC sta-f-f into speci-fic task-oriented 
teams. Cell composition should be reviewed -frequently 
by cell team chie-fs to ensure the most e-f-fective and 
e-f-ficient manning is assigned to conduct the detailed 
sta-f-f work requ i red. Task-Or i ented Cells; 

Support Cell Relation to Prime/Special CAT Member 



Support Cell 

Requirements and Flow Planning 
Manpower/Personnel Readiness 
Mission Support and Augmentation 
Station Data 
Port Management 
Connect i v i ty 
Reports and Brie-fing 
Classi-fied Automated System 
Administrative Support 
CRAF Representatives 
» Functions o-f Interest 
— Mobility o-f aircra-ft. 

— Resolution o-f con-flicting demands. 

— The call-up and employment o-f the 
Fleet (CRAF). 

— Deployment o-f non-unit personnel resources 
— Non-combatant evacuation order (NEC). 
Exercise Selection 
* Powder River 1985 

— HQ me, 15 Oct 84 thru 24 Oct 84. 



to 



Responsibl e 
Operat i ons 
Personne 1 
Operations Plans 
Logi st i cs 
Transports! i on 
Command and Control 
Command and Control 
Command and Control 
CATE 

Assistant -for Civil Air 



Civil Reserve Air 



(NPR) 



* Details to be obtained 

JCS exercise plan and system description notes. 
MAC exercise supplement. 

JCS evaluation guide -forms. 

* Events o-f Interest 

See master events list (S> 

Resources 

* Observers 

— Committed 

NPS Capt Ronald P Buettner 

DSI Mr Dan Bucchioni 

Mr Phil Rice 
DCA Mr John Kirzl 



Possible 

NPS Dr Michael Sovereign 

AFCC — Mr Charles Jacobs (poc -for observers) 
JCS Collection Team members 



Figure 4-2 Initial Collection Plan (continued) 



63 



* Objectives and events to be worked 
— Stationing o-f observers. 

Two in the CAT <see -floor plan, fig 2) 
One or two in the control group. 

— Degree of coverage. 

Oates; Exercise Days 1 & 2, 

Exercise Days 8-10. 

Times: single shift <10-12 hrs) 

Events; To Be Determined. 

— Obtain written data <msg traffic etc) 
Arrange with Col Pagani 



3.0 Approach 

3. 1 Col lect ion 
* Sources 
— JCS 



3.2 



of Data 
exercise plan 
— JCS systems description 
— HQ MAC exercise plan 
— HQ MAC supporting plans 
NEO, others 

* Automatic Distribution 

— Messages and autodin data 
— Telephone logs 
— Briefing si i des 

JCS data collectors worksheets 
Observers 

* Organization 

— Two people in the CAT (physical 
— One or two in the control group 

* Objective-events matrix 

Evolution of HEAT Measures <30, 



1 i m i t ) 



down from 53) 



Data Category 



Measure tt‘'s 



Enemy Units 2, 3, 4, 104, 106 

Combat Units 1, 2, 3, 24, 25, 94, 99, 11 

Support Units 1, 2, 3, 24, 25, 96, 101, 11 

Units not in Theater 1, 2, 3, 97, 102 

Pol i t/Econ/Soc Guidance 11, 40, 65, 74 

Representative coverage of all process steps. 
Direct/coordinate not covered, see fig b-i . 
Representative coverage of all data categories. 
Personnel and Logistics not covered, see fig b-1 . 
Recognize more measures in the monitor and inform 
areas . 



Figure 4-2 Initial Collection Plan (continued) 
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CO (0 



3.3 



Cotwnand Standards 

» Identi-fy -final measures which need command standards. 
* Finalize Proposed Strawman. 



MEASURE ^ 
1 



2 



A 

24 



74 



113 



CIM-IAND STANDARD 

a. iQQ’/. accuracy on aircraft port location 
and operational status 

b. within two UNITREP categories for ground 
units 

c. 100% accuracy for reserve aircraft 
requ i red 

Maximum acceptable time late 

a. aircraft 1 hr 

b . ground un i t 24 hr 

c. reserve aircraft 72 hr 

d. intel status 24 hr 

Desired accuracy location 

a. SAM 1 0 miles 

b. AIR 100 miles 



Time 


-for impl emen tat i on 


Of 


a . 


air movement 


-—24 


hr 


b. 


log response — 


—24 


hr 


c . 


grd movement 


— 24 


hr 



Intended period of plan, determined for each 
pi an 

Intended period of status understanding — 24 hr 



4.0 Timing 

Names of observers for access 

Measures and Command standards strawman for coordination 
» HQ MAC/DOC Col Pagan i 

* HQ MAC/DOOX — Capt Wilkinson 

Reservations accomplished by individuals. 

Courier orders 

Advance party preparations 

* Procedures for access 

* Gather required documents and plans 

* Set up work area 

* Obtain classified storage area 

* Set up automatic distribution 

* Coordinate with JCS data collectors 

5 . Probl em Areas 

Resolve potential conflict of CRAP representation where? 

Potential overcrowding of CAT workarea. Are all members needed^ 



Figure 4-2 Initial Collection Plan (continued) 
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C. FIRST SUPPLEMENTAL COLLECTION PLAN 



This initial plan was deemed suf-ficient when the HEAT evaluation started in 
mid-October. (This was not to be the main evaluation e-f-fort. This was an 
advance party sent to verity clearances and administrative and logistical support. 
Their second objective was to check the -feasibility of the collection plan). 
However^ during this brief two-day visit* the advance party identified some 
shortfalls with the existing collection plan. The observations of the advance 
party led to the following amendments to the Collection Plan (Figure 4-3). In 
addition* the advance party developed data collection aides based on the displays 
used by the Crisis Action Center (Figures 4-4 to 4-7). 

D. SECOND SUPPLEMENTAL COLLECTION PLAN 

This first supplemented plan was based on the information gathered by the 
advance team. It was the first time that any direct observation of the HQ MAC 
CAT was afforded. This first-hand experience of the CAT operations* as limited 
as it was* provided the additional information needed for a workable collection 
plan* or so it appeared. However* during the main collection effort* serious 
deficiencies in collection plan were found. The most serious deficiency was in the 
actual concept of the MAC CAT organization and function. 

Up to this time* the Prime CAT was considered to be the focal point of all 
action for this exercise. This was not true in this particular instance. With the 
inability to obtain actual ground truth information (another serious deficiency in 
the collection plan) due to the nature of this Command Post Exercise (CPX)* the 
actual center of activity was with the Requirements and Flow Planning Cell. (It 
is my opinion that this would be the center of most activity in any exercise or 



HEADQUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 1985 COLLECTION PLAN 
(SUPPLEMENTED 16 OCT 85) 



.0 Background 



2.1 Headquarters to be Studied 

* MAC CAT 

— Required representation. 

Procedure -for calling and the use o-f the Special CAT 

and the -functional units <i.e. Connectivity Cell). 

* Organizational Structure 

Same as initial collection plan 

* Functions o-f Interest 

— Mobility o-f aircra-ft. 

— Resolution o-f con-flicting demands. 

— Allocation o-f Airli-ft Resources 

1. Determine and analyze movement requirements and 
current airli-ft capability to meet those 
requ i remen ts . (mon i tor/under stand) 

2. Prepare manual -flow plan to support requirements, 
(plan) 

3. Prepare worksheets -for -flogen when generating an 
automated airli-ft -flow plan, (plan) 

4. Monitor and analyze automated airli-ft schedule to 
determine airli-ft -flow constraints and make 
improvements . (mon i tor/under stand) 

5. Prepare and coordinate MAC mission directives, 
(d i rect) 



Figure 4-3 First Supplemental Collection Plan 
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3.0 Approach 



3.1 Col lection 

* Sources o-f Data 

JCS exercise plan 
— JCS systems description 
— HQ MAC exercise plan 
— HQ MAC supporting plans 
NEO, others 

* Automatic Distribution 

— Messages and autodin data 
— Telephone logs 
Br i e-f i ng slides 

— JCS data collectors worksheets 



3.2 Observers 

* Organization 

— Two people in the CAT (physical limit) 

— One or two in the control group 

* Objective-events matrix 

— Evolution o-f HEAT Measures (20 from 30 from 53). 

Data Category Measure #-'s 

Combat Units 1, 2, 3, 24, 25, 94, ??, 113 

Individual Op Plans 48, 50, 52, 69, 75-73, SI, 36, 

91, 123 



Figure 4-3 



First Supplemental Collection Plan (continued) 
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MISSION SUMMARY AS OF Z 
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RESPONSIBLE AGENCY 
SOURCE DOCUMENT 



Figure 4-4 Data Collection Aide 1 
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FORCE STATUS 



Z 



AS OF 



UNIT OR 
LOCATION 


AIRCRAFT 


CREWS 




OR 


NORM 


NORS 


OR HRS 
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Figure 4-5 Data Collection Aide 2 
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AIRFIELD DATA 



Z 



AS OF 



LOCATION 


REMARKS 























































































RESPONSIBLE AGENCY 

SOURCE DOCUMENT 

Figure 4-6 Data Collection Aide 3 
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MISSION REQUIREMENTS AS OF 
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contingency involving airli-ft requirements). As such* tor all oi the collection 
effort* the data gatherers were concentrating in the wrong location. Realizing 
the problem* the data gathers tried to adapt the HEAT process (one relying on 
ground truth as a basis) to this particular exercise and in general to any exercise 
where ground truth would not be available or obtainable. The results of this 
effort are documented in the Second Supplemental Collection Plan (Figure 4-3) and 
will be elaborated further in the next chapter. 

E. POST COLLECTION PLAN 

With the realization that most of the data would not support a detailed HEAT 
evaluation (due to the lack of ground truth information)* a search was begun to 
see what information could be extracted from the data. After a complete sifting 
of the data* the only useful and supported analysis was the measure cf 
effectiveness for the intended period of the plan. However* while this is one of 
the major measures in the HEAT process* it did not provide insight into the 
effectiveness of this organization since the one occurrence of plan conflict did 
not occur during the evaluation process. (The data gatherers were not present 
during this period because it was deemed a period of low interest by the MAC 
representative). Thus* a HEAT analysis was not possible v/ith the data capturea. 
However* the attempt to formalize a means to apply HEAT when no actual ground 
truth information is available resulted in useful information and a some what 
successful evaluation. 
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HEADQUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 19S5 
COLLECTION PLAN 
(SUPPLEMENTED 25 OCT 85) 



2.0 Background 

2. 1 Headquarters to be Studied 
» MAC CAT 

— Required representation. 

— Procedure -for calling and the use o-f the Special CAT 

and the functional units <i.e. Connectivity Cell). 

» Organizational Structure 

Same as the initial collection plan. 

* Functions of Primary Interest 

— Mobility o-f aircra-ft. 

— Resolution o-f con-flicting demands. 

— Allocation o-f Airli-ft Resources 

1. Determine and analyze movement requirements and 
current airli-ft capability to meet those 
requ i remen ts . (mon i tor/understand) 

2. Prepare manual -flow plan to support crisis or 
contingency requirements, (plan) 

3. Prepare worksheets -for FLOGB-J (an automated 

airli-ft -flow plan), (plan) 

4. Monitor, analyze and recommend improvements to the 

automated airli-ft schedule, 

(mon i tor/understand/p 1 an) 

5. Prepare and coordinate MAC mission directives, 
(di rect) 

NOTE: All o-f these -functions are per-formed by one 
portion o-f the MAC contingency sta-f-f. the 
Requirements and Flow Planning Cell. It is 
-foreseeable that most o-f the data categories and 
HEAT measures are appropriate -for this cell. If 
the scope of the evaluation was narrowed to the 
monitoring of assets, the building of the plan, 
and directing the execution of the plan; all of 
this can and should be evaluated from within this 
cel 1 . 



Figure 4-8 Second Supplemental Collection Plan 
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3.0 Approach 



3.1 Collection 

* Sources o-f Data 

JCS exercise plan 
— JCS systems description 
— HQ MAC exercise plan 
— HQ MAC supporting plans 
NEO, others 

* Autwnatic Distribution 

— Messages and autodin data 
— Telephone logs 
Br i et i ng si ides 

— JCS data collectors worksheets 



3.2 Observers 

* Organization 

— Two people in the CAT <physical 

— One or two in the control group 

* Objec t i ue-euents matr i X 

— Evolution oi HEAT Measures 
Data Category 
Personnel 
Enemy Objectives 
Combat Units 
Suppor t Units 
Theater Op Plans 
Individual Op Plans 
Critical Shortaoes 



limit) 



<28 vice 20 
Measure tt''s 



or 53; 



21 



120 

110 

o 



13, 

1 , 

1 , 2 , 
81, S6, 
75-73, 
31, 127 



25, 

25, 

91, 

81, 



94, 

9<i, 

122 

86 , 



99 

101 

91 , 



Figure 4-8 Second Supplemental Collection Plan (continued) 
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V. RESULTS AND RECOMMENDATIONS 



A. HEAT RESULTS 

With all o-f the changes and dit-ficulties mentioned in the last chapter, where 
does this leave the HEAT analysis o-f Powder River 1985? Since the analysis was 
to be per-formed on the MAC CAT organization as a whole and that the initial 
collection plan as modified by the advance party Hist suppllemental plan) was 
deemed su-f-ficient (at the time), the analysis et-forts were based on that 
collection plan. While the second supplemental collection plan would be better tor 
a similar analysis ot the MAC CAT now or in the tuture, it is inappropriate tor 
what was observed and collected during Powder River 1985. 

Recall, under the First supplemental Collection Plan, there were a total ot 
twenty HEAT measures to be applied. These twenty measures along with the 
required data sheets and score sheets are presented in Table 5-1. 

TABLE 5-1 POWDER RIVER 85 HEAT MEASURES 



MEASURE 




DATA SHEET 


SCORE SHEET 


1, 2, 3. 94, 


99 


F 


0, F 


4, 25, 48, 50, 


52, 113 


U 


U, A, R 


69, 123 




P 


P, T 


75-78, 81, 86, 


91 


D 


Q, H, D, K 



With these measures selected, the data was collected and compiled onto the 
data sheets. There was little ditticulty in assembling perceived or reported data 
tor the data sheets, however, with the absence ot a ground truth, that category ot 
data was lett blank (reter to Data Sheets Source Type P-perceived, R-reported, 
and T-ground truth). As such, tor Data Sheet F (Figure 5-1) all columns could be 
tilled tor perceived and reported states but none tor ground truth. For Data 



76 




77 



Sheet U (Figure 5-2) only column 1-current situetion» column 5-end of forecast 
periodf and column 6-number of planners could be filled out for the perceived and 
reported states. The remainder of Data Sheet U could not be filled out because 
there was no change in the situations that were observed (the one known change 
in situation the data gatherers were not present due to a period of supposedly 
slow activity). The same comments apply to Data Sheet P (Figure 5-3). Again* 
there was no change in situation observed and no ground truth to record. For 
Data Sheet D (Figure 5-4) little information could be entered. All directives 
issued were for new plans* existing plans or decisions were not changed (for the 
data observed). This resulted in only the time of issue and intended period of the 
plan along with the information on did the directive contradict the commanders 
decision being recorded. 

From these data sheets an attempt was made in scoring the available data. 
Table 5-2 illustrates the score sheets corresponding to the data sheets used and 
their reliance on ground truth to produce a score. 

TABLE 5-2 POWDER RIVER 85 SCORE SHEETS 

Requiring Not Requiring 

Data Sheet Ground Truth Ground Truth 

F 0, F 

U U, R A 

P P, T 

D H Q, D 

With the absence of ground truth only three of the ten score sheets could be 
completed in some detail. Score Sheet A (Figure 5-5) attempts to score the 
planning process relying on a number of alternative actions for each contingency 
actual taken. Since MAC'S plans deal with the generation of an airlift schedule* 
alternative schedules are not considered only one airlift schedule is prepared. 
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Figure 5-5 HEAT Score Sheet 



As such» the rsw amd normalized score is always zero when no alternatives are 
considered. Score Sheet Q (Figure 5-6) attempts to measure the quality o-f the 
plan instead o-f the process. For the periods o-f data collection (recall* the one 
known instance o-f change was not collected), there was no change in situation and 
all plans lasted their intended period. This results in a raw score always equal 
to one. Score Sheet D (Figure 5-7) measures the accuracy of the directive in 
relation to the decision. In all cases observed there was no directive that 
contradicted the commanders decision. This will almost always be the case when 
only one plan is generated and the decision is to implement that plan. 

Thus, for Powder River 1985, HQ MAC prepared quality plans (for the plans 
observed) that reflected the decision of the commander. However, these plans 
were based on only the one alternative and were static in nature. If a change in 
the perceived situation would occur it is doubtful that the plan in effect could 
accommodate the change (as was the case in the one known change not recorded). 

B. PROBLEMS ENCOUNTERED 

There were two major problems encountered in the analysis of HQ MAC during 
Powder River 85. The first was the absence of ground truth, the second was a 
misperception of where the center of planning activity was located. Both of 
these problems stem from one cause, not enough time and effort given to planning 
the collection effort. 

For HEAT to work successfully, a full and thorough understanding of the 
organization and the exercise is required. This was not obtained in this instance 
until well into the collection effort (in fact the collection effort was almost 
over). The failure in understanding the exercise and how it was conducted led to 
the inability to capture ground truth. Knowing that an actual ground truth (that 
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Figure 5-6 HEAT Score Sheet 
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Figure 5-7 HEAT Score Sheet 



normally available during a -field exercise where combat units are actually 
positioned) was not available* procedures or corrective actions could have been 
taken or developed to enable a successful collection effort. This indeed is what 
happened when the Second Supplemental Collection Plan was conceived. The 
misunderstanding of the center of planning activity is secondary in comparison. 
While the main collection effort would not have been focused on the planning 
activity* good reliable data that could be based or compared could be obtained. 
The planning process could not have been evaluated in this posture but most 
other measures could. If both misconceptions could have been avoided a 
successful analysis may have resulted. 

However* to completely overcome the misconceptions* a more thorough 
understanding was required. This takes time. In this respect HEAT is a very 
front loaded* time intensive project. To achieve this detail of understanding, the 
data gatherers must have almost first-hand experience about the type of exercise 
and the organization. Without the time taken to gain this first-hand experience* 
the problem of not knowing where to best place the data gatherers will surface 
again and again. 

C. PROPOSED HEAT APPLICATION FOR FUTURE CPX's 

One of the problems encountered* was the absence of a ground truth. This, in 
part* is based on the notion of ground truth tied to the actual movement of forces 
(either actual movement as in a Field Training Exercise* FTX* or simulated as in 
computer simulation or better controlled CPX). This tying of ground truth to the 
movement/location of force is a hindrance for this type of CPX. Assumptions can 
be made to obtain a quasi ground truth when no forces are involved in the 



exercise. Assumptions o-f this type were the basis oi the Second Supplemental 
Collection Plan. 

In the case o-f Powder River 85» the Requirement and Flow Planning Cell was 
taken as the center o-f activity or planning process. An arti-ficial boundary was 
placed around this cell tor the purpose o-f data gathering. All data within the 
Requirements and Flow Planning cell was considered perceived data while data 
outside the cell was considered ground truth. This enabled the comparison o-f 
data required with HEAT. The comparison in this instance was how well the 
Requirements and Flow Planning Ceil perceived the data that the remaining 
sections o-f the MAC CAT provided. Thus* all the data requirements o-f perceived* 
reported* and ground truth could be captured. 

The question remains* do the results obtained apply to the organization as a 
whole or just to the one part. Given that the arti-ficial boundary encases the main 
planning -function o-f the organization, then the results can be interpreted as 
applying to the entire organization. This will only work i-f the essence of the 
planning activity is enclosed in the boundary. If decisions for the entire 
organization is made outside the imposed boundary then there are other factors 
to consider before the results can be postulated to whole. If on the other hand* 
all organizational decision are made inside the boundary then the essence of the 
organization has been captured <for this purpose) and the results can apply. (This 
is a new concept in applying HEAT and therefore should be approved or recognized 
by HEAT theorist before an application is tried.) 
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D. POTENTIAL AREAS OF FURTHER STUDY 



1. Compu'terized Data Errtrv 

With the use o-f micro computers the sometimes immence task o-f recording 
information may be made easier. At times the observer is overwhelmed with data 
that needs to be recorded. The use of a menu driven or menu aided computer 
device these periods may be less frequent. This has been attempted at the Naval 
Postgraduate School firsts with Dr. J. Lawson in the spring of 1985 and second, 
during the DCA/DSI War Game Exercise in December, 1935. (Both times Radio 
Shack MlOO's were used.) More analysis is needed in the area to confirm that the 
computer aided input is a benefit or not. 

2. Computerized Data Scoring and Presentation 

This area has seen little interest in the past by either DCA or DSI. 
However, some preliminary work was attempted in the spring of 1935. At that 
time, an attempt was made to use a relational data base for the Macintosh (Helix, 
by Odessta) to store the collected data from the HEAT Instruction Manual and 
make queries upon the data similar to the HEAT Score Sheets. The ideal was good 
and the tools did exist (dBase III for example) however, the data base selected 
(Helix) was not fully capable at the time of the undertaking. (Since then, Odessta 
has improved upon Helix with two revision released to make it more capable.) A 
renewed attempt in this area using either Helix or another relational data base 
would prove to be an interesting study. 

3. Testing of the Proposed HEAT Application for CPX's 

This proposed application contained in this thesis requires further 
investigation and testing. Assistance in this endeavor may have to come or 
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originate -from either DSI or DCA. I-f such a study was attempted this author 
would appreciate any knowledge gain from the attempt. 

4. Reevaluation o-f HQ MAC 

Since this thesis did not come to any conclusive results -for HQ MAC» a HEAT 
analysis should still be performed. The Crisis Action Team structure at MAC has 
had time to develop and correct some o-f the inherent problems with a new 
organization. (Powder River 85 was the -first time that this version o-f the MAC 
CAT was ever convened for an exercise.) Also* this study and similar HEAT 
studies would aide the evaluation team in preparing for the analysis. Remember* 
the more time spent in the planning for the evaluation* understanding the 
organization* and knowing the exercise limitations* the better the chance of a 
successful HEAT analysis. 
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